Uso de Canales de Comunicación Adicionales en los Sistemas Conversacionales

In recent years there has been an increasing interest concerning the integration of speech and other communication media in conversational systems, originating the so-called multimodal conversational systems. When several interaction modalities are available, users can receive more feedback from a conversational system and it can also receive more information from users, leading to a reduction of the interaction errors. This paper presents a brief introduction to the multimodal interaction technology, which we plan to set up for the conversational systems developed in our lab. The paper focuses on the most interesting features of multimodal systems, addressing the design techniques and some of the main problems to solve. Finally, it presents briefly the performance of two multimodal conversational systems.